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Abstract 

Marroquin and Ramirez (1990) have recently discovered a class of 
discrete stochastic cellular automata with Gibbsian invariant measure 
that have a non-reversible dynamic behavior. Practical applications 
include more powerful algorithms than the Metropolis algorithm to 
compute MRF models. In this paper we describe a large class of 
stochastic dynamical systems that has a Gibbs asymptotic distribu¬ 
tion but does not satisfy reversibility. We characterize sufficient prop¬ 
erties of a sub-class of stochastic differential equations in terms of the 
associated Fokker-Planck equation for the existence of an asymptotic 
probability distribution in the system of coordinates which is given. 
Practical implications include VLSI analog circuits to compute cou¬ 
pled MRF models. 
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It is well known (see Stratonovitch, 1963, for instance) that one can as¬ 
sociate, under some conditions, to a stochastic continuous automata (i.e., a 
stochastic differential equation) a so-called Fokker-Planck (F-P) equation in 
the probability distribution of the state variables. In this note, we wish to 
characterize conditions under which the F-P equation admits a stationary 
solution of the Gibbs type. 

Let x a n-dimensional vector of state variables, and !F(x,t) the proba¬ 
bility distribution of the state variables described by x at time t. The F-P 
equation is: 




K a y(x) W (x, t) 


where d a (x) is the drift vector and K a ffx) is the diffusion matrix (see Stratonovitch, 
1963, p. 76). 

The stationary solution u;(x) of the F-P satisfies the equation: 
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a = l UX ° 

where we have defined the probability current G a (x) 
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1 d 


2dx, 


K aP (x)w(x) . 
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In order to find the stationary solution, we do not assume, as Stratonovitch 
and everybody else does, that G a (x) = 0 and set u;(x) = e~ u ^ in equation 
(1), obtaining: 
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Assuming that the diffusion matrix is constant, that is K a y(x) = K a p, we 
obtain: 
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o~U(x) 
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A tr(x ) ^ (x) + l Kafl A f;(x) j + A rf „( X) +1 A'„, 3 _A_ f;(x) 


Provided that the diffusion matrix K is invertible we can effectuate the co¬ 
ordinate transformation 


^ 2 KpaXp 

and defining the vector (d)„ = d a (x) we rewrite the previous equation as 
- W • d - W • W + V • d + V 2 U = 

= -W(d + W) + V(d + W) = 0 . 

We finally obtain 

(V-W)-(W + d) = 0, (3) 

which is the condition for stationary distribution. 

Thus, one solution is: 

VU + d = 0^d = -VU, (4) 

which is equivalent to the so called potential conditions , that amount to say 
that d is the gradient of a potential. If the potential conditions are satisfied 
the probability current G a (x) is identically zero, and thus detailed balance 
holds. Therefore we recover the well known result that detailed balance im¬ 
plies the existence of a stationary Gibbs distribution w(x) = e~ u ^\ However 
condition (3) shows that the converse is not true. In fact equation (3) has 
also the solution 


(V — VU) • f = 0, (5) 

with f = VU + d and this solution is not trivial only iff ^0, that is if d is 
not the gradient of a function. Equation (3) has therefore a “larger” space of 
solutions than the one represented by the potential conditions. Of course in 
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both cases the solution C must be such that w(x) = e U ^ x ' > is a probability 
distribution, and therefore the following additional condition must hold: 

J dx e -C/ ( X ) < oo 

A simple and interesting example that proves the existence of non-trivial 
solutions C such that w(x) = e~ u ( x ) is the following. 

Example of existence 

Consider the stochastic differential equation in TZ 2 

f x = -2x + y + &(t) , 

\y = -x-2 y + ( y (t) 

where £ x (t) and 4(0 are Gaussian noise terms, that is 

< &(*)&(*') > = < 4 ( 04(0 > = 26 (* - t r ) . 

The F-P equation associated to (6) is 

JV(x, t) = - V • (W (x, t)d(x)) + 2V 2 fF(x, t) 

where the drift vector is d(x) = (— 2x + y, —x — 2 y). It is easy to verify 
that d(x) is not a conservative held, so that detailed balance does not hold. 
However a stationary solution of the F-P exists, with w(x) = e -C/ ( x ) and 

U(x) = x 2 + y 2 . 

In fact, defining f = VC + d we have 

f = (2x - (2x -y),2y - (x + 2 y)) = (y, -x) 
and therefore equation (5) is satisfied, since 

(V - VC) - f = V- f-VC-f = 2(x, y)-(y,-x) = 0 . 

Notice that in absence of noise the differential equation (6) is linear, with 
characteristic eigenvalues A = — 2 ± i, and the associated trajectories are 
inward spirals. This makes perfectly plausible the fact that, in presence of 
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noise, the probability distribution of the variables is a Gaussian centered in 
the origin. 

Remarks: 

• In the linear case, that is when d(x) = Ax and A is a symmetric matrix, 
detailed balance always holds, because d = —VG with G(x) = — |xAx. 
However the stationary solution w(x) = e~ u exists only if the matrix 
A is negative definite, that is if w(x) is integrable. 

• Stratonovitch (1963, p. 79) says that even when potential conditions 
are not met but d is a linear function of x and K a y(x) are independent 
of x, the F-P equations can be solved. In fact it is easy to see that 
if d(x) = Ax and A is not symmetric the potential conditions do not 
hold but the function G(x) = — |xAx is a solution of equation (5). 

• If the forces d a in the Langevin equation are conservative, i.e., d = 
— VG, then, if the fluctuations are thermic-like, detailed balance is sat¬ 
isfied and a Gibbs stationary distribution exists (Equation 4 is satis¬ 
fied). 

• It appears that our results may be derivable from the formulation of 
Graham (1980) and the more general case considered by Jauslin (1984) 
and Zeeman (1988). An in-depth analysis of many properties of the 
Fokker-Planck equation relevant for this note can be found in Tan and 
Wyatt (1985). 

Acknowledgements We are grateful to J. Wyatt who read this note 
and provided several remarks that go well beyond the scope of it. 
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